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Abstract 

In this paper we show that the lengths of the approximating processes 
in epsilon substitution method are calculable by ordinal recursions in an 
optimal way. 



o. 

^_] ■ Epsilon substitution method is a method proposed by D. Hilbert to prove the 

(-H consistency of (formal) theories. The idea behind the method is that one could 

replace consistently transfinite/non-computable objects as a figure of speech 
by nnitary/computable ones as far as transfinite ones are finitely presented 
as axioms of a theory. In other words, the replacement (epsilon substitution) 
depends on contexts, i.e., formal proofs in which axioms for the transfinite 
objects occur. If this attempt would be successfully accomplished, then the 
k*" | (l-)consistency of the theory follows. 

ilj ■ For example, for first order arithmetic PA, replace each existential formula 

EHxi^cc] by .F[ex..F[x]], where the epsilon term ex.F[x] intends to denote the least 

r»o ■ number satisfying F[x] if such a number exists. Otherwise it denotes an arbi- 

trary object, e.g., zero. Then PA is interpretable in an extended 'propositional 

f - ^ ■ calculus' having the epsilon axioms: 

o : 

(e) F[t] -> ex.F[x] ? t A F[ex.F[x}} (1) 



The problem is to find a solving substitution which assigns numerical values to 
S^ ■ epsilon terms and under which all the epsilon axioms occurring in a given proof 

are true. 

Hilbert's Ansatz is, starting with the null substitution S° which assigns zero 
to whatever, to approximate a solution by correcting false values step by step, 
and thereby generate the process 5' ,S' 1 ,... (H-process). The problem is to 
show that the process terminates. 

In [5] , [5] , [1] , [5] and [7] , we formulated H-processes for theories of jump 
hierarchies, for J£>i(II? V £?), for [II?,II?]-FIX, for n?-FIX and for II^-FIX, 
resp., and proved that the processes terminate by transfinite induction up to 
the relevant proof-theretic ordinals. 

In this paper we address a problem related to these termination proofs, and 
show that the lengths of the processes are calculable by ordinal recursions in an 
optimal way. 



Let T denote one of the following theories; first order arithmetic, the theories 
of the absolute jump hierarchy, theories $-FIX for non-monotonic inductive 
definitions for the formula classes $ = nj, [n^II^jlL]. Let \T\ denote the 
proof-theoretic ordinal of T. 

Given a finite sequence Cr of critical formulas, let {S n } denote the H-process 
for Cr. 

Theorem 1 The length H = min{n : S n is a solution} of the H-process up to 
reaching a solution for Cr, is calculable by \T\- recursion. 
Therefore so is the solution S H . 

1 First order arithmetic: Ackermann's proof 

In this section we give the ordinal-theoretic heart of the epsilon substitution 
method. 

1.1 The H-process 

The language of first order arithmetic PA includes some symbols for computable 
functions, say -I- for addition, • for multiplication and — for cut-off subtraction, 
and the relation symbol <. In its e-countcrpart PAe, formulas and terms are 
defined simultaneously by stipulating that 

if F is a formula, then ex.F is a term. 

By expression we mean a term or a formula. 

An e- substitution S is a finite function assigning values \ex.F\s Gwof canon- 
iraZ(=closed and minimal epsilon) terms ex.F. dom(S) denotes its domain. 

e-substitutions S reduces an expression e to its unique irreducible form \e\s 
by using default value for expressions not in dom(S). 

Let Cr = {CYo, . . . , Ctn} be a fixed finite sequence of closed epsilon axioms. 
S is solving if S validates any critical formula in Cr. Otherwise S is nonsolving. 

The existence of a solving substitution for any finite sequence of critical 
formuls yields the 1-consistency of PA. 

The rank rk(e) < w of an expression e measures nesting of bound variables 
in e. 

Definition 2 rk(S) := max({rfc(e) : e G dom(S)} U {0}). 

For a substitution S and a natural number r, S <r :— {(e, v) G Srk(e) < r}. 

For a fixed sequence Cr, the H-process S°(= 0), S 1 , . . . of substitutions for 
Cr is defined using the ranks of e-terms. The sequence {S n } is primitive (or 
even elementary) recursive. We assume that if S n is a solution for Cr, then 
S m = S n for any m > n. 

By an algorithm, we associate an epsilon axiom Cr(S) to a nonsolving sub- 
stitution S: 

Cr(S) : F[t] ->• ex.F[x] f t A F[ex.F[x}}, 



which is false under S. Then e s := ex.\F\s and v s :— \t\s- 

If S n is nonsolving, then the next substitution is defined as follows. 

S" +1 : = SW") U {(/' ") £ 5 " : rfc ^ = rfc ( e5 ") & / ^ eS "l U {( eS "> « 5 ")}- 

1.2 Termination proof 

In this subsection we recall a proof of the termination of the H-proccss. The 
proof is based on the transfinite induction up to Sq. 
Define the Ackermann ordering: 

x < A y :<&■ [x ^ O&y = 0] V [x,y =10 kx < y] (2) 

Thus is the largest element in <a- \\x\\a denotes the order type of x in the 
ordering <a- 

A relation T \—a S on e-substitutions is defined. 

Definition 3 

TtZ A S :& V(e, u) e 53(e, v) € T[v < A u] 
** |e|x <A Ms for any canonical e 

We associate an ordinal ind(S) < u) u (index of S) relative to a fixed sequence 
Cr of e-axioms. 

Cl € (Cr) denotes the set of closed e-terms occurring in the set Cr. Let 
N(Cr) := #C7 e (Cr)(=the cardinality of the set Cl t (Cr)). N(Cr) is less than 
or equal to the total number of occurrences of the symbol e in the set Cr. 

Definition 4 1. For an e 6 Cl e (Cr) put 

<p{e;S) := ||w|U for v = |e| s . 

£. We arrange the set Cl e (Cr) of cardinality N(Cr) as follows: Cl e (Cr) = 
{d : i < N(Cr)} where 

ej is a closed subexpression of e,; => j > i 
3. 

ind(S) = ^2{{oj + if ■ (f(ei;S) : i < N(Cr)}. 

Let IND := IND(CV) := (w + l) Ar ( Cr ). 

Let r„ = rk(S n ), e n — e s , w„ = v s and a„ = ind(S n ) up to a solution. 
Otherwise let r n — e n — v n — a n — 0. 

The epsilon axiom Cr(S) associated to nonsolving substitutions S depends 
only on their indices ind(S). 

Lemma 5 (Cf. JSj/) 

Let S n and S m be nonsolving substitutions such that S m C^ S n . Then 



2. S m+1 C A 5 n+1 & e„ = e m & v n — v m and r n +\ = r m+ x if a„ = a m . 

Each S n is shown to be correct, cf. [5j. This yields the following fact for 
nonsolving S 1 ™. 

(e„,»)eS"^0/D„<D (3) 

Fix a positive integer RANK = RANK(Cr) := max{rfc(CY) + 1,2}, where 
rk(Cr) := max{rfc(CYj) : / = 0, ...,iV}. Then for any S 1 appearing in the 
H-process, we have rk(S) < RANK. 

Let 

5~*m,k f nnl 
— I'-' Sm<n<k- 

Definition 6 Let S m,k be a consecutive series in the H-process S°, . . . Then 

rk(S m ' k ) := min({ri : m < i < fc} U {RANK}) > 0. 

Definition 7 A consecutive series S m,k in the H-process S°, . . . is a section iff 
r m < rfc(S). 

Definition 8 Let S l — S m ,fe (i — 0, 1) be two consecutive series in the H- 
process S°, . . . such that r m ; < rk{S l ) for i = 0, 1. 

If S"™ C/i S"™ and one of the following conditions is fulfilled, then we write 
S 1 ~< S°: 

1. There exists a, p < minl^ ,^ 1 } [t :— k % — m l ) such that a m o +p > a m i +p 
and Vi < p(a m o +i = a m i +l ). 

2. I 1 < £° and Vi < f(a m o +l = a m i +l ). 

The following Lemma [S] is seen readily from Lemma [5] and © , cf . [S] . 

Lemma 9 Let S l — S m :k (i = 0, 1) be two sections in the H-process S°, . . . 
such that fc° = m 1 and r m o < r m \ < rk(S ). Then 

1. s ml ^ A S m ". 

2. S 1 -< S°. 

Lemma 19121 means that each section S = {Si : i < k} codes an ordinal 
o(S) < £o in Cantor normal form with base 2: Let rk(So) < rk(S) —: r. Divide 
S into substrings which are sections as follows. Put {fco < • • • < h} — {i : i < 
kkrk(Si) = r} U {0}, and S = S Q * • ■ • * Si with S 3 = (S kj ,. . . , S kj+1 - X ) for 
< j < I and ki + i = k + 1. 

The series So, . . . , Si of substrings of S is called the decomposition of S. 

We have Vj < /[S^+i -<; 5j]. 



1 Note that the definition of the decomposition here differs from one in Definition [T_2j 



For ordinals a and a > 2 and k < to, let ao(a) := a and ai + fc(a) := a Qfc ( a - ) . 
Also set Wfc := Wfe(l). 

For each series S — S m,k with r m < rk(S) and a natural number £ such 
that < £ < r — rk(S), associate an ordinal o(S;£) < wrank+2-£ so that the 
following Lemma [TU] holds, cf. [2 for a full definition and a proof. 

Lemma 10 Let S l = S m ,k (i = 0,1) be two series in the H-process S ,... 
such that S 1 -< S° and r m t < rk(S' 1 ) for i = 0, 1. 

T/ien o(S°;t;) > o(S 1 ;S > ) for any natural number £ < min{rfc(S' ), rk(S 1 )}. 

Theorem 11 (Transfinite induction up to Eq) 
The H-process S a , . . . terminates. 

Proof. Suppose the H-process S°, ... is infinite and put r n = rk(S n ). 

Inductively we define a sequence {ni : i £ w} of natural numbers as follows. 
First set no = 0. Suppose n* has been defined. Then put /3, = min{r„ : n > n^} 
and rij+i = min{n > rii : r n = ft}. 

Then Lemma [TU] yields an infinite decreasing sequence of ordinals, viz. 
W[o(5 i+1 ;£) < 0(^5 < WRANK < eo] for S t = S"*>"<+± and f = /3 + 1 > 2. 

a 

Therefore the H-process 5°, ... for any given sequence Cr of critical formulas 
terminates. It provides a closed and solving substitution, which in turn yields 
the 1-consistency RFN s o (PA) of PA stating that any PA-provable Sj'-sentence 
is true. 

However the above proof is not entirely satisfactory. Specifically the 1- 
consistency of PA is known to be equivalent, over a weak arithmetic, to the 
principle PRWO £o , which says that there is no infinite primitive recursive de- 
scending chain of ordinals< eo, or to be equivalent to the totality of So-recursive 
functions. The sequence {n^i and hence the sequence {o(Si;£,)}i of ordinals in 
the above proof are not seen to be recursive. Therefore we need to show that 
the sequence {n^i is £o-recursive in showing the 1-consistency of PA. 

2 Exact bounds: finite ranks 

In this section we show that the length of the H-process up to reaching a solution 
is bounded by an ordinal recursive function. From the bound one can easily read 
off the bound for the provably recursive functions in PA. 

2.1 Ordinal recursive functions 

Let us recall the definition and facts on ordinal recursive functions in W. W. 
Tait[S]. 

Let <a denote a primitive recursive well ordering of type A > 0. Assume 
that is the least element in <a- 

For each a < A, < a denotes the initial segment of <a of type a. A number- 
theoretic function is said to be a-recursive iff it is generated from the schemata 



for primitive recursive functions plus the following schema for introducing a 
function / in terms of functions g, h and d: 

f(v x) = ( 9 ^' ^ if d ^' ^ ^ a X 

nu ' ' \ h(y,x,f(y,d(y,x))) iid(y,x)< a x 

A function is <a-recursive iff it is /3-recursive for some /3 < a. 

W. W. Tait[8], p. 163 shows that for each a the class of a-recursive functions 
is closed under the external recursion to introduce a function / in terms of 
functions g, h, d and e: 

f(v x ) = { 9 ^' ^ if e ^ 7 d ^' X ^ ^ a 6 ^' ^ 

ny ' ' \ h(y,x,f(y,d(y,x))) if e(y,d(y,x)) < a e(y,x) 

2.2 p-series 

In this subsection we define a series S m,k to be a p-series. p-series is introduced 
for counting the number of ranks r n in the H-process.koko 

Given the finite sequence Cr = {Crj : I < N} of critical formulas in PAe, 
let {S n } denote the H-process for Cr. Recall that the sequence is infinite in the 
sense that if S n is a solution for Cr, then S m = S n for any m > n. 

Recall that w" > IND = IND(CY) := (cj + l) N ( Cr ) > a n and u > RANK = 
RANK(CV) > r n for any n. 

For to < fc let 

nd(£ m ' fe ) := {n e [to, k) : r n < rk(S n ' k )} 

(= {n G [to, k) : r n = min(ri : i G [n, k))}). 

Definition 12 Let S = S rn ' k (with to < k) such that r m < rk(S)(i.e., m G 
nd(S)), and let {*:„,.. .,**}< = nd(S). Then (S ,...,Si) with Sj := S k ^ k ^ 
and ki + i := fc is called </ie decomposition of S into substrings. Each substring 
Sj (0 < j < Z) is called a component in the decomposition of 5 

Note that fe = TO, fe; = fe - 1, and rk(S k i) < rk(S k ^ +1 ) < rk(Sj) for j < Z. 
Also note that each component Sj is a section. 

Lemma 13 Let S l = S ?m '- fc ' (i = 0, 1) with k Q = to 1 suc/i i/iai r m i < rfc(S fl ) (i = 
0, 1) and r m a < r m \ . Then for S :— S° * S 1 we have 

nd(5) = {ne nd(S f0 ) : n < 1} U ndCS* 1 ), 

where I := max{n £ [to , k°) : r„ < r m i}. 

Proof. We see I = fcj for a J < Z° from the facts that both {S n : I < n < m 1 } 
and each S* (j < Z°) are sections and fc° = m 1 — 1. Therefore to 1 = fcp = fcj+i 
and the lemma is shown. □ 



Definition 14 Let S = S m - k with m < k such that r m < rk(S). Define 
inductively the series S to be a p-series and a p-section as follows: 

1. S is a 0-series iff k = m + 1, i.e., a singleton. 

,3. A p-series is a p-section iff it is a section. 

5. Let S = Sq * ■ ■ ■ * Si be the decomposition of S into substrings. Then 5" 
is a (p + 1) -series iff each substring 5j is a p-section, or equivalently a 
p-series. 

Lemma 15 1. Each p-series is a (p + 1) -series. 

2. Let S % — S mi,ki (i = 0,1) be two p-series overlapped, i.e., [mo,ko) (~l 
[mi,fci) ^ 0. TTierc the union S = ^»{'»o,n'i},»«{*o,*i} & a p-series. 

3. Let us call ap-series proper i/p = 0, orp > and it is not a (p— l)-series. 

foj If S is a proper p-section, then 

#{rk(S):SeS}>p+l. 

(b) If S is a proper p-series, then 

#{rk{S) :SeS}>p. 

(c) If a proper p-series S begins with S° = 0, then 

#{rfc(S*) :SeS}>p+l. 

Therefore there is no proper RANK-series beginning with S° . 

Proof. By induction on p. 
115111 A 0- series {S n } is a 1- series. 

115121 Assume p > and one is not a substring of the other, i.e., [mi, hi) % 
[mi—i,ki-i). Then without loss of generality we may assume mo < mi < 
k < k\. Decompose the p-series S l to the sequence of (p — l)-series Sj = 
(S^, . . . , S^+i- 1 ) (j < U). It suffices to show: m x < k) < fc =► 3j'{k) = k l f l ). 

This is seen from the condition that each decomposition {Sj : j < li} is a 
sequence of sections with nondecreasing ranks of the first terms. 
115131 Let S = So * • • ■ * Si be a proper (p+ l)-series with nd(o) = {fco, • ■ • , ki} < . 
Then I > and one of p-sections Sj is proper. Lemma fl5!3al yields #{rfc(5') : 
S £ Sj} > p + 1, and hence Lemma 11513b! follows. 

If So is proper, then rk Q < r^ < rk(So) since ^o is a section. Hence 
#({rk(S) : S e So} U {r fcl }) > p + 2. Next assume j > 0. Then r kf) < r k . < 
rk(Sj), and #({rfc(S') : S £ Sj} U {r fco }) > p + 2. This shows Lemma[15l3a] 

Lemma [I5l3cl is seen from the fact r n > for n > 0. Namely any proper 
p-series S beginning with S° — is a section. □ 



Lemma 16 Let S l = S m ' k (i = 0, 1) be two consecutive series, k° — m 1 such 
that r m i < rfc(S' 1 ) (i = 0, 1) and r m o < r m \ . 

The concatenated series S = S m ° ,kl is a (p+l)-series if S° is ap-series and 
S 1 is a (p + l)-series. 

Proof. This is seen from Lemmas [13] and 115111 □ 

Let < eo denote a standard well ordering of type £o with the least element 0. 

Lemma 17 Let S l = S m ,k (i = 0, 1) be two p-series such that k° — m l , S k _1 
is nonsolving and r m a < r m i. For o(S l ) := o(S' l ;0) we have o(S 1 ) < £o o(S ). 

Proof. By Lemma [TU] it suffices to show S 1 -< S°. As in Lemma |H] this is seen 
as follows. Let t := k l — m*. 

Since the relation \—a is transitive, we have S m Qa S m by Lemma 19111 
Using Lemma[5l it suffices to show that the following case never happen: £° < I 1 
and Vi < £°[a m o +i = a m i +i }. 

If this happens, then we would have a m i_i = a m o +e o_ 1 = a m i + £o_ 1 , and 
hence S m 9 (e m i_i,w m i_i) = (e m i + ^o_ 1 ,« m i + ^o_ 1 ) by Lemma [5121 On the 
other hand we have S ml+l °- 1 H A S™ 1 by Lemma HU 

For a v <a v m i + io_ l we would have (e m i + ^o_ 1 ,w) G S m +e -1 . By @ we 
have ^ v I „i + £o_ 1 < v. A contradiction. □ 

k = M(p, n) defined below will denote the number such that S n,k is the 
longest p-series starting with nonsolving S n . 

Definition 18 M(0, n) := n + 1. 

Case S n is solving: M(p+ l,n) := n. 

Case 1 S n is nonsolving. Let 

e p (n) := o{S n > M{p ' n) ). 

Then define 

r M(p, n) if ep(Af (p, n)) ft eo e p (n) 

M(p+1, n) := I M(p, n) if r M ( P , n ) < r n & e p (M(p, n)) < 6o e p (n) 

[ M(p + 1, M(p, n)) if r M ( Pi „) > r„ & e p (M(p : rij) < eo e p (n) 

Actually the function M(p,n) depends also on the given sequence Cr of 
epsilon axioms. We write M (p, n; Cr) for M(j>, n) when the parameter Cr should 
be mentioned. 

A consecutive series S n ' is a normal p-series iff it is a p-series and S k ~ x is 
nonsolving if k > n. 

Lemma 19 1. If S n is nonsolving, then S n,M ( p,n > is a normal p-series. 
2. If S n ' is a normal p-series, then k < M{p,n). 



3. S H is a solution for Cr, where H = H{Cr) := Af (RANK - 1,0; Cr). 

Proof. 

119111 Main induction on p. The case when p = is trivial. 

The case p + 1 is proved by side induction on e p (n). Assume that S n is 
nonsolving. 

1. M(p+ l,n) = M(p,n): Then by MIH(=Main Induction Hypothesis) 
gn,M(p,s) j s a norma i p-series. S n,M ^ p ' s ' is also a normal (p + l)-scrics 
by Lemma 115111 

2. Af (p+1, n) 7^ M(p, n): Then with k = M(p, n) we have r k > r n and M(p+ 
1. n) = M(p+1, fc). By MIH S™'* is a normal p-series. Since M(p+l, k) ^ 
k, S k is nonsolving, and hence by MIH, S k < M ( p,k > is a normal p-series. 
Lemma Q7| yields e p (n) = o{S n ' k ) > (S k ' M{ P> k )) = e p {k). Therefore 
gk,M{p+i,k) j s a norma i (p+1 )-series by SIH(=Side Induction Hypothesis). 
Together with r n < r^ it follows from Lemma \W\ that ( 5 , ™^ m (p+ 1 i ™) j s a 
normal (p + l)-series. 

119121 Main induction on p. The case when p = is trivial. 
The case p + 1. First we show the following: 

n < n < M (p, n) => M (p, n) < M(p, n) (4) 

Assume n < n' < M(p,n) =: k and n' < M(p,n') :— k'. Then by Lemma T19I1I 
gn,k anc j gn ,k are ^ w0 norma j p-geries overlapped. By Lemma 115121 the union 
^n,max{fc,fc'} is & norma i p_ ser ies too. By MIH it follows that k' < M(p, n). This 
shows (gj). 

Now by side induction on k — n we prove: 

If S n - k is a normal (p + l)-scries, then k < M(p + 1, n). 

Assume that S n,k is a normal (p + l)-series, and nd(5 n,fc ) = {fco, . . . , fe}<, 
Z > 0. Then by MIH we have fci < M(p,n). Let j < I denote maximal such 
that kj < M(p,n). 

1. kj — M(p, n): Since § j ' is a normal (p + l)-series, we have by SIH that 
k < M(p + l,kj). On the other hand we have M(p + l,n) = M(p + 
l,M(p,n)) by Definition [HI r kj > r ko = r„ and e p (M(p, n)) < eo e p (n), 
Lemma fT71 Hence k < M(p + 1, kj) = M(p + 1, n). 

2. fcj <Af(p,n): 

(a) j = /: Then fc; < M(p,n), and hence fc = fc; + 1 < M{p,n) < 
M(p + l,n). 

(b) j < I: Since S kj ' kj+1 is a normal p-series, we have kj+i < M(p, kj) by 
MIH. On the other hand we have M(p, kj) < M(p, n) by @. Thus 
kj+i < M(p, n), and this is not the case. 



119151 Let H = H(Cr) := M(p, 0; Cr) for p := RANK - 1. If 5° is solving, then 
= H. Suppose that S° is nonsolving. By Lemma [19111 5*°'^ is ap-series. From 
Lemma [TBI and r = < r# we see that 5°>- H '+ 1 is a (p + l)-scrics. But this 
means that S 0,H+1 is a p-series by Lemma ll5l3cl Therefore we see from Lemma 
[15121 that S°' H+1 is not normal, i.e., S H is solving. □ 

Lemma 20 The function (p, n, Cr) h-> M(p,n;Cr) is SQ-recursive. 

Proof. It suffices to see that M(p, n; Cr) is defined by nested recursion on the 
ordinal eq- Then it is eo-recursive by a result in W. W. Tait[5] and u) e ° — Eq. 

Suppressed the parameter Cr, let us define a function M'(p, n, y) as follows: 

M'(0,n,y) :=n + l. 

Case S n is solving: M'{p + 1, n, y) := n. 
Case 1 S n is nonsolving. 

1. o(S m '(p>™^)> m '(p> m '(p>™^)^)) ^ e y : 

M'(p + 1, n, y) := M'(p, n, y). 

2. r M , (p , n>!/) < r n ho{S M '^ n ^ M '^ M '^^y)) <eg y , 

M'(p + 1, n, y) := A/'(p, n, y). 

3. r M , (p ,„, y) > r n ko{§ M '<*™WW <*»»)*)) <£o y: 

M'(p+l,n,y) :=M'{p+l,M , {p,n,y),o{S M ' < - p ' n ^^ M '^ M ' {p - n ' v) ' v) )). 

Then M'(p,n,y) is seen to be defined by nested recursion on the lexicographic 
ordering -< on pairs (p, y): (p, y) ~< (q, z) iff p < q or p = q & y < £o 2. 

Then M(p, n) := M'(p, n, WRANK+2) enjoys the defining clauses in Definition 

us n 

3 Exact bounds: infinite ranks 

In this section let us compute the length of the H-process for theories of jump 
hierarchies, which is slightly modified from [2]. 

The normal function 9 a : f3 h-> 9a/3 is the a iterate of the function 61(3 — 
uj". Fix an ordinal A < Tq, the least strongly critical number, and let <r 
denote a standard primitive recursive well ordering of type To with the least 
element 0. In what follows the subscript in <r is omitted. 

Let A(x,a, z, X) be a fixed quantifier free formula in the language of first 
order arithmetic. Let (-ff)A denote the theory of the absolute jump hierarchy 
{H a } a <A generated by the formula A and up to a < A: 

a <r A4{|/eff a o 3xA{x,a, y,H <a )} 
10 



where H <a = J2fs< a Hpt i- e -> H <a denotes the binary abstract {(j3, z) : (j3, z) £ 
H <a }- 

The critical formulas in its e-counterpart are the e-axiom ([1]), 

a < A -> {t £ H a o A(exA(x, a,t, H <a ),a,t, H <a )} 

and 

a < A^ {(/3,t) £ H <a o /3 < a At £ H fj } 

Now the rank of an expression is defined such that rfc(e) < 3 A + u. For a 
given finite sequence Cr of critical formulas, let RANK=RANK(Cr) = 3A+ri > 
rk{Cr) := max{rfc(Cr/) : J = 0, . . . , A^} for an n < u. 

An e-substitution is a finite function assigning numerical values \ex.F\s £ to 
to canonical terms ex.F, and boolean values \e\s — T for expressions e in one 
of the shapes n £ H a or (/3, n) G H <a such that /3 < a < A. 

Define the Ackermann ordering <a and ||x||a as in ([2]), where for boolean 
values, _!_ <a T and ||_L||a = 0, ||T||^ = f . 

Define the index md(5) < IND = IND(C*r) = (u + f) A '( Cr ) < w w of 5 
relative to a fixed sequence Cr of critical formulas as in Definition SJ 

3.1 Bounds on p 

Since RANK > u>, Lemma ri5!3cl is useless here. We need to give a bound on p 
such that M(p, n; Cr) < M(p + 1, n; Cr). 

Let £ p — M(p+ 1, 0; Cr). {£ p } is an increasing sequence t v < t p +\, and once 
£ p = tp+\, then £ p = £ q for any q > p. 

Now let p(Cr) denote the least number p such that l p = £ p+1 if such a p 
exists. We show that the number p(Cr) is defined. Then S H is a solution of Cr 
for H = M(p(Cr),0;Cr). 

For eachp, let 5 p +i = {5" l }n<^ p be the (p + l)-section according to Lemma 
119111 and S p +i = Sp~ * • • • * 5/ its decomposition into p-sections S p . 

Let o(5) = o(5;0) < 6»(RANK)(IND) < 6»Ae denote the ordinal associated 
to sections S as in [5] . 

Then let a p = o(5 p ) for < j < l p , and a° := 0(RANK)(IND). 

By Lemma [T71 we have 

a p > a p +1 (5) 

Moreover let j p — r k j+i (0 < j < l p ), where S " is the first term in the 



substring S 3 p +1 for j < l p , and k p = I 
Finally let for A := RANK > 7p ' 



p- 



8Ae >(3 P :=J2 A "h P = A a ° 7 ° + • • • + A< 7p ^ 
From ([5]) we see that /3 P is in Cantor normal form. 
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Lemma 21 (3 p > (3 p+ i if t p < £ p+ i. 

Proof. Assume £ p < £ p +i. This means that S ip is nonsolving. 

By] 

Let 



By Lemma T19I2I we have 7/ > 7 P P 



J = min{j < Z p - 2 : 7 j> > 7^ 1 }. 

Then 

kj } = max{« <£ p :n< j 1 /' 1 } 

and by Lemma [T51 we have S p+1 — S p for < j < J. Hence a p+1 = a J p for 
< j < J, and lp+l = 7^ for < j < J. 

Consider the next substitution S lp to the last one in S p or equivalently the 
last one in S p +\. Then S lp is the next substitution to the last one in S p +l by 
Lemma [13] 

Hence j p > -f p p = j p+1 - Therefore f3 p > /3 p+ i as desired. □ 

Now p(Cr) = F(0, Cr) for the function 

F(p,Cr)-$ F{p+hCr) if W>^P 



min{g < p : £ q +\ = £ q } otherwise 
F(p, Cr) is defined by a 6*Aeo-external recursion by Lemma |2"T1 

4 Exact bounds: impredicative cases 

Let T denote one of the theories $-FIX for non-monotonic inductive definitions 
for the formula classes $ = n?, [n?,n?],n§ (cf. [3], @], [5] and [7]). 

O(T) denotes the system of ordinal diagrams for T. T is a two sorted theory: 
one sort for natural numbers, and the other sort for ordinals. The well ordering 
< on ordinals is understood to be the ordering in the notation system O(T), 
when the values of expressions are calculated. Its largest value is denoted it £ 
O(T), which is intended to be a closure ordinal of non-monotonic inductive 
definitions by the operators in $. fl < tt is the first non-recursive ordinal uj^ k . 
dn£iv+i denotes the proof-theoretic ordinal of T, and the length of the H-process 
should be calculated by dn£7r+i-recursion. 

The rank of an expression is defined such that rfc(e) < tt + uj. For a given 
finite sequence Cr of critical formulas, let RANK=RANK(Cr) = ix + n(Cr) 
for an n(Cr) < u so that max{r/c(Cr 7 ) : / = 0, . . . , N} < RANK. Then 
tt y^ rk(S) < RANK for any S appearing in the H-process for Cr. 

Define the index ind(S) < IND = IND(CY) = (vr + l) N ( Cr ) < vr" of S 
relative to a fixed sequence Cr of critical formulas as in Definition SJ 

In Definition 1181 M (v, n) is defined by ^-recursion, i.e., o(S) < 7r w , and 
p(Cr) is defined by e^i-rccursion, i.e., o{S) < £^+1, which are far from dn^ir+i < 
O < vr" < e n+x . 

For the moment, suppose that M(p, n) has been defined for each p < lu. Let 
£ p = M(p + 1,0; Cr). 
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If 3p < n(Cr)[£ p — £ p +i], then there is nothing to prove, i.e., p(Cr) < n(Cr). 
In what follows assume Vp < n(Cr)[£ p < £ p +i], and let p > n(Cr). Suppose 
£ p < lp+i- Then S lp is nonsolving. 

Consider the number 

m p := max{n < £ p : r n < n} (6) 

Note that m p is in the set nd(S°' tp ). 

Proposition 22 p > n(Cr)&i£ p < £ p+ i => it > r„ lp > rg p . 

Proof of Proposition [2U Suppose p > n(Cr), £ p < £ p+ i and r m < re . By 
Lemma H9l4l we have M(p, n) < M(p + 1, n) < M(p +1,0) = £ p for any n < £ p . 
If M{p 1 m p ) = £ p , then we would have M(jp + l,n) > £ p by r„ lp < rg p . Hence 
n p := M(p, m p ) < £ p . On the other hand we have r n > 7r > r m , and hence 
M(p, m p ) < M(p+1, m p ) < £ p . From this we see that 5™p: M (p+!. m p) [ s a proper 
(p + l)-series. Therefore a component in the decomposition of > 5 m p. M (p+ 1 .»™p) 
is a proper p-series. On the other side any component except the first one is 
an improper p-series by r n > it (m p < n < £ p ), Lemma 11513 bl and p > n(Cr). 
Hence the first component S mp ' m (rn' < M(p,m p )) is a proper p-series. But 
then #{rk(S n ) > ir : m p < n < to'} > p — 1 > n(Cr) by Lemma I15l3bt This is 
a contradiction. We have shown Proposition [22j □ 

For eachp > n(Cr), let S p +i = {S n } n <i be the (p+ l)-section. Decompose 
S p +i into S'p+i = Si * ■ " * S p * S p p where the last substring S p p is defined 
to be S mp,(,p for the number m p in ©, and each S-J, = S kp ,k p (1 < j < l p ) for 
{(0 =)k° p , k p ,..., 4 P_1 (= rn p )} < C nd(5 p+1 ). Put k p p = £ p . 

Let o(S) = o(S;0) < dnw„(c r )(7r) denote the ordinal associated to p-series 
5 as in [3], @], [5] an d H- Note the following fact: 

a < w„(c r )(7r) for any subdiagram d q G a occurring in ranks, indices and 
o(S), which appear in the H-proccss for Cr (7) 

Then let at — o(S p ) for < j < l p — 1, and a° p := duOJ n (Cr)(^)- 
We have, cf. Theorem 11.7 in [3J 

ft > a p > a p +1 (8) 

Let j p :— r k i+i (0 < j < l p ) and A :— tt > 7^. Finally let 

j<i P 
Lemma 23 dn/3 p G 0(T), and daf3 p > do/? p+ i if £ p < £ p+ i and p > n(Cr). 
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Proof. To show dn(3 p £ O(T), we have to verify a condition Z?>n(/3 p ) < (3 p 
for a set B > n((3 P ) of subdiagrams of (3 p . This is seen from (JT]) and £>>n(/3 P ) = 

B>n(u-.j<i P }). ; 

Assume £ p < £ p +i and p > n{Cr). Let 

J = min{j</ p -2: 7 ^>7^- 1 }. 

Note that by Proposition [51] we have r m = 7/ > 7/ = r^ . 

Then as in the proof of Lemmal2"Tlwe see a p+1 = a p for < j < J, 7 p+1 = 7 p 
for < j < J. Moreover we have 7 p > 7/" = 7 p+ i- Therefore (3 p > (3 p +i- 

It remains to show Kq/3 p +i < da(3 p . By ((U it suffices to see Kq{j p+1 : 3 < 
lp+i} < dnfi P - 

If T=$-FIX for $ = [n5,n?],n°, then there is nothing to prove, i.e., 

Kabi+i ■ 3 < l P +i} = 0- 

Consider the case $ = 11° and tt = O. Then we have i^n{7 p+1 : j < l p +i} < 
a° p = dnu) n{Cr )(ty <d n P P by Q. □ 

It remains to define M (p, n) by dn^+i-recursion. This is seen from the 
following lemma. 

Lemma 24 Let S l = S mi:ki (i = 0,1) be two consecutive p-series, fco = m i- 
Assume r TOl > r„ l0 . Then o(S 1 ) < o(S°). 

Proof. This is seen as in Lemma[l7l i.e., Theorems 10.8 and 11.7 in [3]. □ 
Thus we have shown that both M (p, n; Cr) and p(Cr) are defined by dne^+i- 
recursion. This yields a solution S H of Cr for H = M(p(Cr), 0; Cr). 
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